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Comment: Integrating Epidemiologic 
Data into Risk Assessment 


Daniel Wlartenbeig, PhD, and Ronald Simon, JD 


Paliqrmaken use two principal tools 
in evaluating human health ri^ epidemi- 
ology and quantitative risk assessmeiiL 
Epidemiology is the gold standard be¬ 
cause it assesses directly human health 
risk. However, when epidemiologic data 
do not exist or when epidemiologic stud¬ 
ies are not condusive. regulators often 
turn to quantitative risk assessment. For 
example, wc know the dangers of smoking 
cigarettes and the benefits of low-fat diets 
and exercise through series of observa¬ 
tional epidemiologic studies. We know 
the utili^ of a variety of drugs and surgical 
procedures thtou^ carefully controlled 
ch'nical trials. However, with compounds 
less well studied in humans, such as 
dioxin, quantitative risk assessment is 
relied Upon to sec regulatoiy poltc^. Using 
epidemiology to assess human health risk 
is not controversial; using quantitative risk 
assessment is. To explain this difference 
and the possible implicatioiu of using 
epidcmiolo^ data in quantitative risk 
assessment, we explain the basics of 
quantitative risk asscssmenL point out 
some of its limitations, and raise some 
cautions on the use of epidemiolDgic data 
in quantitative risk assessment models. 

Quantitative risk assessment is a 
statistical method designed to forecast 
human health risk where risk is hard to 
measure directly, as with people who 
shower in water contaminated with Hi- 
chlorclhylene or who dwell beside Super- 
fund sites.'- The baric tenet of quantita¬ 
tive risk assessment is that data on health 
effects detected in small populations of 
animals exposed to high concentrations of 
su^rcct chemicals can be used to predict 
health effects in large human populations 
NOTICE 
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eiqxKed to lower concentrations of the 
same chemical. Most federal agencies 
conform to a 1983 National Academy of 
Sdences report^ that delines quantitative 
risk assessment as a four-stage process. 
Hiough each stage has objective ele- 
menis, each also requires sotns decisions 
based on subjective judgeinents into which 
personal values may enter. Disagreement 
and controvert^ often follow. 

The goal of the first stage of quantita¬ 
tive risk assessment, hazard idattificaiion, 
is to identify all situations or substances 
that can, in any amount, pose a risk to 
human health as well as all the possible 
adverse health effects. Omission of com¬ 
pounds or specific health effects from 
consideration at this stage can undermine 
the validity of a quantitative risk assess- 
ment. 

The goal of the second stage, eapo- 
surt asxametn is to estimate for each 
material listed in the hazard identification 
stage the amount a typical person is likely 
to enoounter. The three components to 
dlls step are determination of the source 
of the substance, the moveinent of the 
substance through the environment, and 
the uptake by people (i.e., ingestion, 
inhalation, and denna] etqxisuie}. Omis¬ 
sion of sources, exposure pathways, bio- 
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concenualioii factors, and absorption and 
transformation coefficients can reduce 
the accuracy of estisnates. 

The third stage, dose-nspomemodel¬ 
ing, determines the amount of each 
substance that causes hanii. For carcino¬ 
gens, this is typically called the "cancer 
potenty." Most often, risk assessors use a 
mathematical model that describes the 
logarithm of the risk as a linear hmetion 
of dose, without a threshold below which 
there is no impact. Both the assumptions 
of linearity and no threshold have come 
under criticism, as well as the implicit 
assumption that each compound acts 
independently of all other exposures. 

In the fourth stage, risk characteriza¬ 
tion. the risk assessor combines the infor¬ 
mation from the three other stages into a 
single overall estimate of risk. For each 
chemical listed in stage t, the predicted 
cumulative exposure is calculated for an 
average (or worst case) peison over an 
entire average (or worst case) lifelimc 
(stage 2) and multiplied by the potency 
estimated (stage 3) to derive a predicted 
risk of cancer for that individual These 
risks for each compound arc added up to 
get a total risk for the activity being 
evaluated, suidi as residing near a solid 
waste incinerator or inhaling bcnxcncwhcn 
tilling up an aulamobile gasoline lank. 
Implicit in summing of these risks is the 
assumption of independent (not interac¬ 
tive) but additive (not multiplicative) ef¬ 
fects. These assumptions arc contmvcisial 

The assumptions used in quantitative 
risk assessment highlight some of its 
limitations. Compounds may be omitted 
inappropriatclyor measured inadequately, 
and their effects may be modeled improp¬ 
erly. Emus may nvcrcstimatc or under¬ 
estimate the true risk. Advocates of 
quantitative risk a.sscssmcnt, while ac¬ 
knowledging these limitations, argue that 
the quantitative eflccLs of these errors are 
small and that the benefits of the objectiv¬ 
ity of the method far outweigh this 
concern. Yet, surprisingly little effort has 
been made cither to quantify these poten¬ 
tial errors or to validate the approach. 

What has been done has revealed 
problems. For example, cvaluatioasof the 
consistency of the animal data have shown 
substantial disparities.-'^ Tests Of carcino¬ 
genicity in animals of the same species but 
different sex arc consistent with each 
other only about 65% to 85%; in those of 
the same sex hut diflerent species animals 
tests were consistent only 50% to 75%; 
and cancer occurred at the same anatomi¬ 
cal site across species in only 35% la 50Cf 
of the tests. Without even addressing the 


potenqt of carcinagenic chemicals, which 
can vaiy by several orders of magnitude 
across animal spedes for the same chemi¬ 
cal, these disparities raise questions about 
the general utiliqr of quantitative risk 
assessment for predicting carcinogenicity. 

Similaily, quantitative risk assess¬ 
ment results are not entirely compatible 
with human epidemiologic data.^*^ In one 
study, the differences between risks pre¬ 
dicted with the rat and mouse data and 
the results of human epidemiologic stud¬ 
ies ranged over 10 orders of magn!tude.'° 
Even the rank orders of risks often did not 
agree.o Reasons postulated for such 
discr^andes include inadequate human 
exposure data, biased sampling (c.g., the 
healthy worker effect in occupational 
studies, partially “etqwsed’' controls in 
case-control studies), uncontrolled con¬ 
founding, genetic variabiticy, variations in 
susceplibili^, behavior and Ufes^le, and 
interactive effects.'*-'' 

For a few compounds, investigators 
have provided analyses, explanations, and 
sometimes adjustments for these appar¬ 
ent discrepandcs,but overall there 
has been no systematic evaluation and 
etqslanation of these discrepancies. In 
spite of this, most sdentists agree that 
using these data is preferable to arbitrary 
or sutjective decision making. Rather 
than invalidating the use of quantitative 
risk assessment, these problems pose 
challenges that must be investigateil By 
identifying and understanding the ambigu¬ 
ities and inconsistencies, we can increase 
our knowledge and ability to predict risk. 
However, we also must make dear the 
uncertainty and impredsion of the risk 
estimates derived with the current meth¬ 
odology. 

In this Public Health Policy Forum. 
Hcrtz-Piccioito extends this approach. 
She proposes the use of epidemiologic 
data, where available, in place of the 
animal data typically used in the dose- 
response modeling stage of quantitative 
risk assessment and offcis a protoco! for 
evaluating the quality of epidemiologic 
studies. Her general proposal for the 
evaluation of epidemiologic data is not 
contraversiaL However, we believe that 
the U.SC of epidemiologic data withmit 
additbnal caveats may compound rather 
than alleviate the shortcomings of quanti¬ 
tative ride assessment risk estimates. 

For example, one limitation of much 
epidcmkilogic data is their insensitivity or 
low siatLstical power. Even if a true 
exposure-disease assodaiion exists, an 
epidemiologic study may fail to show an 
effect simply because the sample size is 


too small To detect associations of regula¬ 
tory importance, typically risks of lO'*- 
10*' or less, studies often need a mini¬ 
mum of seveial thousand subjects. Such 
studies of low risk are expensive, difficult 
to conduct, and hence relativefy rare. 
Nonetheless, sanction for the use of 
epidemiologic data in quantitative risk 
assessment models may tempt many to 
dismiss the risks of carcinogenlciiy on the 
basis of studies without positive results 
but lacking power. Some have argued that 
with some epidcmiotagic data in hand, 
and in the absence of proof of hazard, one 
should assume relative safety. But, as 
Dol]'* notes, cautioning against the use of 
human data in preference to animal data 
in assessing human health risks, “Proof of 
absence of an effect by epidemiologic 
means... is, however, veiy much harder 
to achieve than proof that an effect is 
produced.... Negative human evidence 
may mean very little, unless it relates to 
prolonged and heavy exposure." 

A second limitation of relying on 
epidemiologic data in quantitative risk 
assessment is that compounds believed to 
be hazardous cannot etbicalfy be adminis¬ 
tered to human subjects. Thus, no human 
experimental studies of suspect chemicals 
can be undertaken; and in those situations 
in whidt people are knowingly being 
exposed to a suspect chemical, action 
must be taken to r^uce exposure rather 
than study the consequences thereof. 

A third limitation of using epidemio¬ 
logic data in quantitative risk assessment 
is that while epidemiolo^c studies invite 
less extrapolation than animal ctqseri- 
ments, they are more subject to bias, 
confounding, and effect modiffcation (in¬ 
teraction). Often, suffidem data are not 
available to identify or fully control for 
these effects. While epidemiologic meth¬ 
ods exist to adjust, in part, for these 
problems, most quantitative risk assess¬ 
ment models do not allow for this. The 
consequence of using biased or con¬ 
founded data is that predicted risks may 
markedly overestimate or underestimate 
the true risk. 

Using epidemiologic data with quan¬ 
titative risk assessment models wiffiout 
adequate caution can lead CO erroneous 
condusions and could promote unsafe but 
preventable exposures. This concern is 
borne out by the mai^ compounds thought 
to be safe on the basis of early epidemio¬ 
logic studies which, upon further stuefy, 
have been found to be hazardous (c.g., 
dioxin). Any rules or guidelines suggesting 
use of epidemiologic data in quantitative 
risk assessment must address this issue 
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bead on. Negative and inconclusiveepide- 
miologscstudies (such as those that do not 
meet the standards of statistical signiR- 
cance) should be considered only if the 
poiver of eadi study is incorporated in the 
calculations, for example, by using the 
largest possible effect that could have 
gone undetected, along with a thorough 
assessment of bias and confounthng. Dis¬ 
carding positive animal data in preference 
for limited, imprecise or confounded 
epidemiologic data must be avoided. 

The Agent Orange litigation is an 
example of how misunderstanding epide- 
inkilogic concepts can lead to deleterious 
social effects. In the Agent Orange ton 
litigation, US District Judge Jack B. 
Weinstein made a detailed review of 
scientific evidence that Agent Orange 
exposure had caused particular diseases. 
The court rejected scientific opinion in 
support of causation because of “nega¬ 
tive” epidemiologic studies.'* 

In recent years, the National Acad¬ 
emy of Sciences, the Department of 
Veterans Affairs, and the Environmental 
Frotection Agency have determined that 
a wide variety of adverse health effects are 
related to Agent Orange exposure.”-*^ 
Veterans brought product liability cases 
against the manufacturers of Agent Or¬ 
ange. The courts determined that the 
legal rights of these veterans had already 
been deiennined by the litigation decided 
by Judge Weinstein even Ihou^ the 
veterans had not become ill and did not 
have legal claims until years after that 
decision. Thus negative epidemiologic 
infoimation was used to infer safety, and 
that inference took legal precedence even 
after additional data were collected that 
showed hazard. Nonetheless, regulatory 
decisions need to be made about expo¬ 
sures and their likely, or possible, impact 
on human health. These dectsinns about 
the carcinogenicity and relative potency of 
chemicals are made not to advance scien- 
itfic knowledge, but to reach decisions 
about public health protection. 

Sdenlifically, we can gain most by 
validating the models we use and develop¬ 
ing new ones to accommodate all avail- 
abie data. We must refocus efibrts to 
assess the assumptions underlying quanti¬ 
tative nsk assessment and the validity of 
the metbcKl instead of quantifying the 
uncertainty resulting from inadequate 


data, as is currently being done. We must 
use all aninid'^and epidemiok)^ data 
together rather than selecting onfy one or 
a few data sets, possibfy weighting each by 
source, qualify, and statistical power. 
Heterogeneity between data sets should 
be understood as pit^ities of the data 
rather than viewed as discrepancies or 
errors. 

On the regulatory front, the best 
strategy is more complex. In the long 
term, the sturfy ofbiologica} mechanisms 
and pharmacokinetics offer hope for 
tesoh^g many disetepandes between 
species. In the meantime, wc must ac¬ 
knowledge explicitly the limitations of our 
data and our models as well as the 
inconsistencies in the data for the spedfic 
chemical being studied. Rather than 
choosing one t^ of data over another, 
we must try to use all data to explain the 
heterogeneity and to accommodate it. 
Rather dian presenting results of quantita¬ 
tive risk assessment as precise estimates of 
expected risk (i.e., with confidence inter¬ 
vals derived from Monte Carlo simula¬ 
tions that focus on assumptions about the 
exposure data distributions), we should 
conduct sensilhify analyses underbroader 
sets of assumptions (W instance, using 
dilferent exposure regimes. aKernalivc 
dose-response models, alternative inter- 
spedes adjustments, etc.). IMien esti¬ 
mates diverge under different models, we 
should seek explanations for these diver¬ 
gences, not averages or atbittary priorities 
for the models. 

Only by owning up to the limitations 
of the methodology do we stand any hope 
of improving it By accepting the incom¬ 
pleteness and conflicting nature of data, 
we can use it to make social dedsions that 
reflect the poiiticat nature and scientific 
understanding of the alternatives being 
considered. The subjective and situation- 
specific input required is preferable to 
deluding ourselves about the accuracy 
and precision of the data and models used 
for rendering objective decisions. □ 
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